Remote work-support system

ABSTRACT

Provided is a remote work-support system including a first display device to be worn on a first user working at a work site, a surrounding imaging device disposed on the work site, and an information processing device provided at a predetermined spot, configured to be communicable with the first display device and the surrounding imaging device, and operated by a second user. The first display device includes a first communication unit transmitting first image data to the information processing device. The surrounding imaging device includes a second communication unit transmitting second image data to the information processing device. The information processing device includes second display devices displaying the first and second image data, an operation unit through which data is input, and a third communication unit transmitting data input by the second user through the operation unit to the first display device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of priority from Japanese PatentApplication No. JP 2019-122778, filed Jul. 1, 2019, the entire contentsof which are incorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a remote work-support system.

2. Description of the Related Art

In recent years, so-called wearable information display terminals andthe like which each displays predetermined argumented reality (AR),mixed reality (MR), or virtual reality (VR) information using aglasses-type head-mounted display have begun to appear on the market. Inaddition to AR, MR, and VR, wearable terminals which each includes aninterface that appeal to the five senses of humans, such as voice,display, vibration, temperature, smell, taste, an electric signal,stimulation, and the like have also begun to appear on the market. Alongwith this, in this type of wearable terminals, various methods relatingto control of the AR information display terminal and the like andvarious utilizations have been proposed. As an example, the paragraphs0118 and 0119 of the specification of JP 2007-163634 A discloses thatwhen “the behavior state of the user U is determined to be “non-walking”on the basis of the detection result from the acceleration sensor or thelike as described above, the mode is automatically switched to thedetailed mode. Further, in accordance with the table illustrated in FIG.17, an item is selected from each of the display fields of “Sender”,“Title”, “Sending time”, “Cc”, and “Body”. As a result, as illustratedin FIG. 16B, detailed character information is displayed on the entirescreen.” “In contrast, when the behavior state of the user U isdetermined to be “walking” on the basis of the detection result from theacceleration sensor or the like, the mode is automatically switched tothe summary mode. Further, an item is selected from each of the displayfields of “icon” and “sender” according to the table illustrated in FIG.17. As a result, as illustrated in FIG. 16A, the user U causes only theicon and the sender's name to be displayed with characters larger thanthose in the detailed mode, on part of the central area of the screen.”

SUMMARY OF THE INVENTION

Incidentally, in a case where a wearable terminal is applied toindustrial use, maintenance use, or the like, for example, a worker onsite wears the wearable terminal. At the same time, for example, thereis a request that a manager or the like at a remote place acquire datacollected from the wearable terminal via a network and check the worksituation. However, simply transmitting data collected from the wearableterminal to the manager or the like may not allow the worker and themanager or the like to appropriately cooperate.

The present invention has been made in view of the above circumstances,and an object of the present invention is to provide a remotework-support system that allows a plurality of users to appropriatelycooperate.

In order to solve the above problems, a remote work-support systemaccording to the present invention includes a first display device to beworn on a first user working at a work site, a surrounding imagingdevice disposed at the work site, and an information processing deviceprovided at a predetermined spot, configured to be communicable with thefirst display device and the surrounding imaging device, and operated bya second user, the first display device including a first display unitthat displays information to the first user, a first imaging unit thatcaptures an image in front of the first display device and outputs firstimage data, and a first communication unit that transmits the firstimage data to the information processing device, the surrounding imagingdevice including a second imaging unit that outputs second image dataincluding an imaging range different from an imaging range of the firstimage data, a transmission control unit that performs a low-resolutionprocess or a high-resolution process on the second image data asnecessary, and a second communication unit that transmits the secondimage data to the information processing device, and the informationprocessing device including a second display device that displays thefirst image data and the second image data, an operation unit throughwhich data is input, and a communication unit that transmits data inputby the second user through the operation unit to the first displaydevice.

According to the present invention, a plurality of users canappropriately cooperate.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an overall configuration diagram of a remote work-supportsystem according to an embodiment of the present invention;

FIG. 2 is a block diagram illustrating an example of a configuration ofa wearable terminal;

FIG. 3 is a block diagram illustrating an example of a configuration ofa surrounding camera;

FIG. 4 is a block diagram illustrating an example of a configuration ofan information processing device;

FIG. 5 is a sequence diagram illustrating an example of a work startprocedure;

FIGS. 6A to 6D are views illustrating various screens to be displayed ona display in the work start procedure;

FIG. 7 is a schematic view illustrating an environment in which amanager performs work-support;

FIG. 8 is a view illustrating a display example of two displays;

FIG. 9 is an explanatory view of enlarged display operation;

FIG. 10 is a view illustrating another display example of two displays;

FIG. 11 is an explanatory view of scroll operation;

FIG. 12 is a view illustrating another display example of two displays;

FIG. 13 is a view illustrating an example of various virtual screens;

FIG. 14 is a schematic view illustrating an environment in which aresolution reduction process is performed;

FIG. 15 is a flowchart of a resolution reduction process routine;

FIG. 16 is a flowchart of a focused-on spot notification routine;

FIG. 17 is a view illustrating another example of the various virtualscreens;

FIG. 18 is a flowchart of a detailed focused-on spot notificationroutine;

FIG. 19 is a schematic view illustrating focused-on spot notifyingoperation using a laser pointer; and

FIG. 20 is a view illustrating a display example of a display on which athermographic image is superimposed.

DESCRIPTION OF THE PREFERRED EMBODIMENTS Configuration of Embodiment(Entire Configuration)

In the following embodiment, when necessary for the sake of convenience,the description will be made by dividing the description into aplurality of sections or embodiments; however, unless otherwisespecified, the plurality of sections or embodiments are not unrelated toone another, and one is a modification, a detail, a supplementaryexplanation or the like of part or the entirety of the other.

Further, in the following embodiment, in the case of referring to thenumber (including the number, the numerical value, the amount, therange, and the like) and the like of elements, except a case where thenumber and the like are particularly specified, a case where the numberand the like are clearly limited to a specific number in principle, andthe like, the number and the like are not limited to the specificnumber, and may be equal to or more than or equal to or less than thespecific number.

Furthermore, in the following embodiment, it is needless to say that theconstituents (including the element steps, and the like) are notnecessarily essential, except a case where the constituents areparticularly specified, a case where it is clearly considered that theconstituents are essential in principle, and the like.

Similarly, in the following embodiment, in the case of referring to theshapes, positional relationships, and the like of the constituents, thesubstantially approximate or similar shapes and the like are included,except where the shapes, positional relationships, and the like areclearly specified and the case where it is clearly considered that thesubstantially approximate or similar shapes and the like are notincluded in principle. This applies similarly to the above numericalvalue and range.

In all the drawings for describing the embodiment, identical members aredenoted by identical reference numerals in principle, and the repeateddescription thereof will be omitted.

FIG. 1 is an overall configuration diagram of a remote work-supportsystem 1 according to an embodiment of the present invention.

In FIG. 1, the remote work-support system 1 includes a wearable terminal100, a surrounding camera 200, an information processing device 300, aline-of-sight detection sensor 400, and a distance measurement sensor500 (posture detection unit). Here, a worker 10 (first user) who is at awork site W1 wears the wearable terminal 100 and performs various works.The wearable terminal 100 has a substantially eyeglass shape, andincludes a transmission-type head mounted display (HMD), a camera, andthe like (not illustrated). In particular, the camera mounted on thewearable terminal 100 captures an image from the viewpoint of the worker10. The surrounding camera 200 is disposed near the worker 10.

A management center C1 (predetermined spot) is provided in a remoteplace away from the work site W1. A manager 20 (second user) who is anexpert stays in the management center C1, and the information processingdevice 300, the line-of-sight detection sensor 400, and the distancemeasurement sensor 500 described above are set around the manager 20.

When the worker 10 arrives at the work site W1, the worker 10 wears thewearable terminal 100 (first display device) on the face and sets thesurrounding camera 200 (surrounding imaging device) at any place. Here,the surrounding camera 200 is also called a spherical camera, a360-degrees camera, or a 180-degree camera, and refers to a camera thatcaptures 360-degrees panoramic and moving images in all of the up, down,left and right directions, and 180-degrees panoramic and moving imagescorresponding to a hemisphere. The surrounding camera 200 is portable,and is carried and set by the worker 10 every time the worker 10 movesto one work site to another work site. The set location of thesurrounding camera 200 may be set, for example, close to the worker 10so as to obtain a bird's eye of the worker 10 as if the manager 20 atthe management center C1 is standing by the worker 10 and watching thework situation.

Note that similarly to the work site W1, also in other work sites W2 andW3, a worker 10, a wearable terminal 100, and a surrounding camera 200are disposed (not illustrated), and the manager 20 can check the statusof these work sites W1, W2, W3 via the information processing device300. The wearable terminal 100, the surrounding camera 200, and theinformation processing device 300 can perform two-way communication viaa communication network 600. Note that the communication network 600 maybe any network such as a wide area network (WAN), a local area network(LAN), or a 4G (long term evolution (LTE))/5G.

For example, the information processing device 300 receives imagessupplied from the surrounding camera 200 and the wearable terminal 100,and displays the images on a plurality of (two in the illustratedexample) displays 376, 378 (second display devices). By viewing theseimages, the manager 20 can simultaneously grasp the work situations ofthe workers 10 and the situations around the sites. Here, in order forthe manager to view the image with a high sense of reality, asmall-medium display is preferably applied to the display 376 thatdisplays the image from the wearable terminal 100. Further, a displaylarger than the display 376 is preferably applied to the display 378that displays the image from the surrounding camera 200. In particular,the large display 378 is not limited to a flat panel display, and may bea spherical display or a semi-spherical display. In addition, it ispreferable that the small-medium display 376 that outputs the image fromthe wearable terminal 100 is set in front of the manager 20 and thelarge display 378 is set behind the small-medium display 376 so that themanager 20 can intuitively determine which is the image from thewearable terminal 100 and which is the image from the surrounding camera200.

The line-of-sight detection sensor 400 and the distance measurementsensor 500 in the management center C1 detect various types of movementof the manager 20. For example, the line-of-sight detection sensor 400can detect which display is being viewed by the manager 20, and whichpart of the display is being viewed, and can acquire coordinates on thedisplay. For this reason, the line-of-sight detection sensor 400includes an infrared camera, a near-infrared camera, a visible lightcamera, a light source, and the like, and has a function of detectingthe line-of-sight direction of the manager 20. The distance measurementsensor 500 is also called a three-dimensional sensor, and has a functionof acquiring three-dimensional position information of the body, head,hands, arms, and the like of the manager 20 by using a time-of-flight(TOF) sensor, a stereo camera, or the like. The distance measurementsensor 500 detects movement of the body, head, hands, arms, and the likeof the manager 20 by detecting the distance between the body, head,hands, arms, and the like of the manager 20 and the distance measurementsensor 500. Although details will be described later, the informationprocessing device 300 allows the manager 20 detected by the distancemeasurement sensor 500 to scroll the image from the surrounding camera200 displayed on the display in a non-contact manner on the basis ofmovement of the manager 20.

Cloud 30 includes a plurality of information processing devices such asa server device, and a storage. The cloud 30 is connected to thecommunication network 600 and stores images from the wearable terminal100 and the surrounding camera 200, and also stores information on theworkers 10 and the manager 20, and network configuration information ofeach of the work sites W1, W2, W3. In addition, the cloud 30 analyzesdata of various sensors mounted on the wearable terminal 100 and varioussensors set at the work site, converts the data into informationvaluable to the manager 20, and then transmits the information to theinformation processing device 300 of the manager 20. For example, thecloud 30 can analyze vital data of the worker 10 measured by a vitalmeasurement unit 164 (see FIG. 2) mounted on the wearable terminal 100,can convert the fatigue or stress of the worker 10 into a numericalvalue, and can notify the manager 20 of the numerical value. Further,the cloud 30 manages and monitors the devices, terminals, and the likeof the work sites W1, W2, W3, and notifies the manager 20 of an errorwhen the error occurs.

As described above, according to the remote work-support system 1illustrated in FIG. 1, the manager 20 can check the image from theviewpoint of the worker 10 via the small-medium display 376. Further,the manager 20 can operate and view the image around the site byhimself/herself via the large display 378. Then, since the manager 20can move his/her viewpoint as if the manager 20 were at the work siteW1, the manager 20 can grasp the situation of the site including theworker 10 in detail.

(Wearable Terminal 100)

FIG. 2 is a block diagram illustrating an example of a configuration ofthe wearable terminal 100. Note that in the illustrated example, anoperation function and an arithmetic processing function are integratedin the display device attached to the head part of the worker 10 (seeFIG. 1).

In FIG. 2, the wearable terminal 100 includes a communication unit 102(first communication unit), a power supply unit 103, a light source unit104, a control unit 110, an operation unit 130, a sensor unit 160, astorage unit 170, and a display unit 180.

The communication unit 102 transmits and receives various data to andfrom the cloud 30, the information processing device 300, and the likevia the communication network 600 (see FIG. 1) under control of thecontrol unit 110. Further, the communication unit 102 also includes aninterface of a short-range communication such as WiFi, Bluetooth(registered trademark), low-power wide area (LPWA), and a universalserial bus (USB). Thus, an additional input/output device (notillustrated) can be connected to the communication unit 102, and anoperation command or the like can be input/output via the additionalinput/output device.

The power supply unit 103 includes a built-in or external battery or thelike and supplies power to each unit of the wearable terminal 100. Thelight source unit 104 includes one or a plurality of light sources (notillustrated) that illuminates the area in front of and around thewearable terminal 100 in the case of using the sensor unit 160 or in acase where the surrounding environment is dark. In particular, in a casewhere the irradiation range of the light source is narrow, it ispreferable to provide a plurality of light sources. Further, by settingthe light source unit 104 at each of both ends of the wearable terminal100, a wide irradiation range can be realized.

Here, the operation unit 130 includes an input operation unit 131 and avoice input/output unit 132. The input operation unit 131 includes aninput device (not illustrated) such as a button, a touch panel, aswitch, a dial, an external mouse, or a keyboard and a driver forcontrolling the device so that various data can be input by the worker10 (see FIG. 1). The voice input/output unit 132 includes a microphone,an earphone, a speaker, and the like (not illustrated). The worker 10can input voice data to the control unit 110 via the microphone, and thecontrol unit 110 can output voice data to the worker 10 via theearphone, the speaker, or the like.

Further, the sensor unit 160 includes an imaging unit 161 (first imagingunit), an inertial measurement unit 162, an environment measurement unit163, and a vital measurement unit 164. The imaging unit 161 sets thefront of the worker 10, who is a user, that is, the field of view of theworker 10 as an imaging target, and captures a still image or a movingimage with 4 k/8 k resolution and outputs image data V1 (first imagedata).

The inertial measurement unit 162 includes an acceleration sensor, agyro sensor, a geomagnetic sensor, a global positioning system (GPS)device, and the like (not illustrated). Thus, the inertial measurementunit 162 acquires or estimates the line-of-sight direction, theline-of-sight position, the posture, the current position, and the likeof the worker 10. The environment measurement unit 163 includes anilluminometer, a thermometer, a hygrometer, an environment microphone,and the like (not illustrated), and acquires or estimates information onthe environment around the worker 10. Further, the environmentmeasurement unit 163 generates a thermographic image 612 (see FIG. 20)on the basis of the measurement result of the thermometer or the like.The vital measurement unit 164 includes a heart rate monitor, athermometer, a sphygmomanometer, a pulse meter, anelectroencephalograph, and the like (not illustrated). Thus, the vitalmeasurement unit 164 acquires physical information of the worker 10, andestimates the physical condition and emotion of the worker 10.

The storage unit 170 includes an authentication unit 171, a skillmanagement unit 172, and a communication destination registration unit173. More specifically, the storage unit 170 has a nonvolatile memorysuch as a ROM or a flash ROM (FROM), and stores various parameters,programs, and the like. The functions of the authentication unit 171,the skill management unit 172, the communication destinationregistration unit 173, and the like are realized by these parameters,programs, and the like.

When communication is performed between the wearable terminal 100 andthe information processing device 300 or the cloud 30, theauthentication unit 171 restricts access of personal authentication,device authentication, service authentication, and the like. The skillmanagement unit 172 manages static information such as names,affiliations, occupations, work histories, years of experience, andqualifications of a plurality of users who can be the workers 10. Thecommunication destination registration unit 173 manages addressinformation and the like of terminals and services that communicate viathe communication unit 102. For example, in the case of using theservice of the cloud 30, a URL such as “http://(IP address of the cloud30):(port number)/service ID” is set. Note that the storage unit 170 maybe provided outside the wearable terminal 100. For example, the storageunit 170 may be provided in the cloud 30 connected via the network, andthe wearable terminal 100 may access the storage unit 170 as necessary.

The display unit 180 includes a display control unit 182, a left displayunit 184 (first display unit), and a right display unit 186 (firstdisplay unit). As described above, the wearable terminal 100 has aglasses-type configuration, and the left display unit 184 and the rightdisplay unit 186 are provided at positions corresponding to left andright eye glasses. The display control unit 182 controls the positionand timing of the screens displayed on the left display unit 184 and theright display unit 186. As a result, the left display unit 184 and theright display unit 186 function as a transmissive HMD, and show avirtual screen 190 to the worker 10. Note that although one virtualscreen 190 is illustrated in FIG. 2, the display unit 180 can show aplurality of virtual screens 190 to the worker 10.

The control unit 110 executes a control process, a real-time imageprocess, and the like of the entire wearable terminal 100. The controlunit 110 includes hardware as a general computer such as a centralprocessing unit (CPU), a digital signal processor (DSP), a graphicsprocessing unit (GPU), a random access memory (RAM), a read only memory(ROM), and the like. The ROM stores a control program executed by theCPU, a microprogram executed by the DSP, various data, and the like. InFIG. 2, inside the control unit 110, functions realized by a controlprogram, a microprogram, and the like are illustrated as blocks.

That is, the control unit 110 includes a transmission control unit 112and a virtual screen control unit 114 (screen control unit). Here, thetransmission control unit 112 switches whether or not to transmit theimage data V1 from the communication unit 102. In the case oftransmitting the data, the transmission control unit 112 sets the datarate. Further, the virtual screen control unit 114 causes data suppliedfrom the information processing device 300 (see FIG. 1) to be displayedon the virtual screen 190 via the display unit 180.

Note that the wearable terminal 100 does not have to be an eyeglass-typeas long as the worker 10 can wear the wearable terminal 100. Further,the control unit 110 may be configured integrally with the sensor unit160, the operation unit 130, and the like.

(Surrounding Camera 200)

FIG. 3 is a block diagram illustrating an example of the configurationof the surrounding camera 200.

The surrounding camera 200 includes a communication unit 202 (secondcommunication unit), a power supply unit 203, a light source unit 204, adisplay unit 208, a distortion correction/image synthesis unit 209(second imaging unit), a control unit 210, an operation unit 250, asensor unit 260, a storage unit 270, and a laser pointer 222 (directiondisplay unit).

Here, the communication unit 202, the power supply unit 203, the lightsource unit 204, and the operation unit 250 are configured similarly tothe communication unit 102, the power supply unit 103, the light sourceunit 104, and the operation unit 130 of the wearable terminal 100 (seeFIG. 2), respectively.

The sensor unit 260 includes imaging units 261, 262 (second imagingunit), an inertial measurement unit 263, and an environment measurementunit 264. The imaging units 261, 262 include a wide-angle lens (notillustrated). The imaging units 261, 262 capture a high-resolution360-degrees panoramic 4 k/8 k resolution still image or moving image ofthe entire circumference in the up, down, left and right directions, andoutput image data VX1 and VX2, respectively. In addition, the inertialmeasurement unit 263 and the environment measurement unit 264 areconfigured similarly to the inertial measurement unit 162 and theenvironment measurement unit 163 of the wearable terminal 100 (see FIG.2).

The distortion correction/image synthesis unit 209 corrects distortionin a peripheral portion generated in the image data VX1 and VX2,combines the image data VX1 and VX2, and outputs a panoramic image dataV2 (second image data) that is a still image or a moving image.

The laser pointer 222 emits a laser beam in a coordinate directionspecified by the control unit 210 for the purpose of, for example,pointing a specific place to the worker 10. Note that, instead of thelaser pointer 222, a plurality of light sources (for example, LEDs) maybe disposed on a surface of a housing of the surrounding camera 200, andthe light sources in the corresponding directions may be turned on.

The display unit 208 is, for example, a flat panel display, and displaysvarious pieces of information under control of the control unit 210.

More specifically, the storage unit 270 has a nonvolatile memory such asa ROM or a flash ROM (FROM), and stores various parameters, programs,and the like. The storage unit 270 has a communication destinationregistration unit 272, the contents of which are similar to those of thecommunication destination registration unit 173 of the wearable terminal100 (see FIG. 2) described above.

The control unit 210 includes hardware as a general computer, such as aCPU, a DSP, a GPU, a RAM, and a ROM. The ROM stores a control programexecuted by the CPU, a microprogram executed by the DSP, and variousdata, and the like. In FIG. 3, inside the control unit 210, functionsrealized by the control program, the microprogram, and the like areillustrated as blocks. That is, the control unit 210 includes atransmission control unit 212. Here, the transmission control unit 212switches whether or not to transmit the panoramic image data V2 from thecommunication unit 202, and in the case of transmitting the panoramicimage data V2, sets the data rate.

(Information Processing Device 300)

FIG. 4 is a block diagram illustrating an example of a configuration ofthe information processing device 300.

The information processing device 300 is, for example, a generalpersonal computer or a server device, and includes a communication unit302 (third communication unit), a power supply unit 303, a light sourceunit 304, a control unit 310, an operation unit 350, a storage unit 360,and a display unit 370. In addition, the control unit 310 is connectedto a line-of-sight detection sensor 400 and a distance measurementsensor 500. The line-of-sight detection sensor 400 supplies datarepresenting the line-of-sight detection direction of the manager 20(see FIG. 1) to the control unit 310 as line-of-sight direction data GD.Further, the distance measurement sensor 500 supplies the posture andthe movement of the manager 20 to the control unit 310 asposture/movement data PM.

Here, the communication unit 302, the power supply unit 303, the lightsource unit 304, and the operation unit 350 are configured similarly tothe communication unit 102, the power supply unit 103, the light sourceunit 104, and the operation unit 130 of the wearable terminal 100 (seeFIG. 2).

The display unit 370 includes the above-described displays 376, 378, anddisplay control units 372, 374 that control the displays 376, 378.

The storage unit 360 has a nonvolatile memory such as a ROM or a flashROM (FROM), and stores various parameters, programs, and the like. Thestorage unit 360 includes an authentication unit 361 and a skillmanagement unit 362, and the contents thereof are similar to those ofthe authentication unit 171 and the skill management unit 172 of thewearable terminal 100 (see FIG. 2) described above.

The control unit 310 includes hardware as a general computer, such as aCPU, a RAM, a ROM, a GPU, and an SSD. The SSD stores an operating system(OS), an application program, various data, and the like. The OS andapplication programs are loaded on the RAM and executed by the CPU. InFIG. 4, inside the control unit 310, functions realized by theapplication program and the like are illustrated as blocks.

That is, the control unit 310 includes a superimposition control unit312, a scroll control unit 314, a line-of-sight correspondence controlunit 316, and a visual image determination unit 318. As a result, thecontrol unit 310 outputs images and information received from thewearable terminal 100, the surrounding camera 200, the cloud 30, and thelike to the display unit 370.

The superimposition control unit 312 superimposes other information onthe image data V1 and the panoramic image data V2 as necessary. Thescroll control unit 314 scrolls the panoramic image data V2 displayed onthe large display 378 in the vertical or horizontal direction on thebasis of the line-of-sight direction data GD or the posture/movementdata PM. Further, the visual image determination unit 318 determineswhich of the image data V1 and the panoramic image data V2 the manager20 is viewing on the basis of the line-of-sight direction data GD, anddetects the coordinate position at which the manager 20 is viewing.

In addition, the line-of-sight correspondence control unit 316determines whether or not the manager 20 is in a predetermined posture(for example, a slouching posture) on the basis of the posture/movementdata PM. Then, in a case where the manager 20 is in a predeterminedposture and focuses his or her eyes on a substantially constantcoordinate position for a predetermined time or more, the line-of-sightcorrespondence control unit 316 enlarges and displays the surroundingrange of the coordinate position in the image data V1 or the panoramicimage data V2.

Operation of Embodiment (Work Start Procedure)

FIG. 5 is a sequence diagram illustrating an example of a work startprocedure. FIGS. 6A to 6D are views illustrating various screens to bedisplayed on the displays 376 and 378 in the work start procedure.

In FIG. 5, when the cloud 30 detects the occurrence of an error in anyof the devices and terminals managed and monitored, the informationprocessing device 300 notifies the manager 20 of an error via thedisplay unit 370 (step S501). For example, the information processingdevice 300 displays an error screen 601 illustrated in FIG. 6A on thesmall-medium display 376.

It is assumed that the manager 20 checks the details of the errorgenerated by operating the error screen 601 and determines that it isnecessary to dispatch a worker to the site where the error has occurredas a countermeasure. Then, the manager 20 transmits a dispatch requestto a mobile terminal of any worker 10 (step S502). At this time, thedetails of the error and information on the site where the error hasoccurred are preferably transmitted to the worker 10. The worker 10receives the dispatch request (step S503), and checks the details of theerror and the information of the site where the error has occurred.Next, the worker 10 carries the wearable terminal 100 and thesurrounding camera 200 (see FIG. 1) and moves to the site where theerror has occurred (step S504). Here, it is assumed that the site wherethe error has occurred is, for example, the work site W1 illustrated inFIG. 1.

When the worker 10 arrives at the site where the error has occurred,that is, the work site W1, the worker 10 wears the wearable terminal 100and operates the power supply unit 103 (see FIG. 2) to turn the powersupply unit 103 ON (step S505). The powered-on wearable terminal 100acquires user information (information on the user) stored in the skillmanagement unit 172 (see FIG. 2). Further, the wearable terminal 100acquires current position information from the inertial measurement unit162. Next, the control unit 110 of the wearable terminal 100 acquiresaddress information of the cloud 30 stored in the communicationdestination registration unit 173 and the address information of theinformation processing device 300 managed by the manager 20, andaccesses the information processing device 300 via the communicationunit 102. Then, the wearable terminal 100 transmits the acquired userinformation and current position information, and starts live streamingdistribution of image data V1 captured by the imaging unit 161.

In contrast, the manager 20 detects dispatch of the worker 10 byreceiving a notification or an image from the wearable terminal 100 viathe information processing device 300 (step S506). At this time, forexample, screens 603, 604 illustrated in FIG. 6C are displayed on thesmall-medium display 376. Next, the worker 10 sets the surroundingcamera 200 at any place on the work site W1, and operates the powersupply unit 203 (see FIG. 3) to turn the power supply unit 203 ON (stepS507). The surrounding camera 200 whose power is turned ON acquires thecurrent position from the inertial measurement unit 263 (see FIG. 3).The control unit 210 of the surrounding camera 200 acquires the addressinformation of the cloud 30 stored in the communication destinationregistration unit 272 and the address information of the informationprocessing device 300 managed by the manager 20, and accesses theinformation processing device 300 via the communication unit 202.

Then, the surrounding camera 200 transmits the acquired current positioninformation and starts live streaming distribution of panoramic imagedata V2. The information processing device 300 displays such informationvia the large display 378 (see FIG. 4). As a result, the manager 20visually recognizes the notification and the image from the surroundingcamera 200 via the display 378, and detects that the surrounding camera200 is set (step S508). At this time, for example, one of the screens605, 606 illustrated in FIG. 6D is displayed on the display 378 on thebasis of the panoramic image data V2.

Next, the manager 20 prepares a procedure manual and drawings to beexecuted by the worker 10 and transmits the procedure manual anddrawings to the wearable terminal 100 of the worker 10 (step S509). Atthis time, the manager 20 may input the execution contents by voice viathe voice input/output unit 352 of the information processing device300, and may adopt the procedure manual obtained by converting the voicecontents into text. The wearable terminal 100 that has received theprocedure manual and the drawings displays the procedure manual and thedrawings on a virtual screen 190 generated by the display unit 180 (seeFIG. 2).

The worker 10 checks the contents of the displayed procedure manual anddrawings, and performs necessary work preparations (step S510). Next,when the worker 10 uses the voice input/output unit 132 to input a voicesaying “start work”, the content is transmitted to the informationprocessing device 300 via the communication unit 102, and are displayedon the displays 376, 378 (see FIG. 4). The manager 20 starts worksupport for the worker 10 while watching the images displayed on thedisplays 376, 378 (step S511).

(Partial Enlarge Display Operation)

FIG. 7 is a schematic view illustrating an environment in which themanager 20 performs work-support. In the illustrated example, thesmall-medium display 376 is disposed below the large display 378. Then,as described above, the display 378 displays the panoramic image data V2and the like from the surrounding camera 200, and the display 376displays the image data V1 and the like from the wearable terminal 100.The manager 20 can grasp the state of the work site W1 while watchingthe images on the displays 376, 378.

The line-of-sight detection sensor 400 is set below the displays 376,378, and the distance measurement sensor 500 is set beside or above themanager 20. Here, a plurality of the line-of-sight detection sensors 400may be set. For example, the plurality of line-of-sight directionsensors 400 may be set below the display 376 and below the display 378.Similarly, a plurality of distance measurement sensors 500 may be set.For example, the distance measurement sensor 500 may be set on each ofthe side and above the manager 20, respectively.

FIG. 8 is a view illustrating a display example of the two displays 376,378. In the illustrated example, the screen 606 illustrated in FIG. 6Dis displayed on the large display 378 on the basis of the panoramicimage data V2. Further, a screen 604 illustrated in FIG. 6C is displayedon the small-medium display 376 on the basis of the image data V1.

FIG. 9 is an explanatory view of enlarged display operation.

A posture 22 illustrated in FIG. 9 is a normal posture of the manager20. A posture 24 is a posture of the manager 20 looking into thedisplays 376 and 378 with a slouch. When the manager 20 views the imageson the displays 376, 378 in the posture 22, the manager 20 wishes to seea specific portion of the image in detail in some cases. In that case,the manager 20 takes the posture 24 of looking into a specific part witha slouch. Then, the distance measurement sensor 500 detects the posture24, and outputs posture/movement data PM indicating that the posture 24is detected to the control unit 310 (see FIG. 4) of the informationprocessing device 300.

Next, the visual image determination unit 318 determines which of theimage data V1 and the panoramic image data V2 the manager 20 views onthe basis of the line-of-sight direction data GD, and detects thecoordinate position at which the manager 20 is viewing. As a result, theline-of-sight correspondence control unit 316 enlarges and displays thesurrounding range of the coordinate position in the image data V1 or thepanoramic image data V2. Here, when the posture of the manager 20returns to the original posture 22 (see FIG. 9), the distancemeasurement sensor 500 detects the posture, and outputs theposture/movement data PM indicating that the posture is returned to theoriginal posture 22 to the control unit 310 of the informationprocessing device 300. In contrast, the control unit 310 returns thedisplay state of the image data V1 or the panoramic image data V2 to theoriginal state (see FIG. 8).

FIG. 10 is a view illustrating another display example of the twodisplays 376, 378. As an example, it is assumed that the screens 604,606 illustrated in FIG. 8 are displayed on the displays 376, 378. Then,it is assumed that the manager 20 focuses his or her eyes on thevicinity of the center of the screen 606 in the posture 24 (see FIG. 9)of looking into the vicinity with a slouch. Then, as illustrated in FIG.10, a screen 608 in which the vicinity of the center of the screen 606is enlarged is displayed on the display 378. Note that the screen 604similar to that of FIG. 8 is displayed on the display 376. As describedabove, the image can be enlarged and reduced by natural operation of themanager 20.

(Scroll operation #1)

FIG. 11 is an explanatory view of scroll operation.

The illustrated posture 22 is similar to the posture of the manager 20illustrated in FIG. 7. Here, the manager 20 wishes to scroll thepanoramic image data V2 displayed on the large display 378 in somecases. In such a case, as the posture 26 indicates, the manager 20performs movement of swinging the hand or the arm in a scroll direction.The distance measurement sensor 500 detects this movement and suppliescorresponding posture/movement data PM to the control unit 310 of theinformation processing device 300. Then, the scroll control unit 314(see FIG. 4) in the control unit 310 scrolls the panoramic image data V2in the direction in which the manager 20 is swinging his or her hand onthe basis of the posture/movement data PM. Note that the direction inwhich the panoramic image data V2 is scrolled is, for example, thehorizontal direction or the vertical direction.

FIG. 12 is a view illustrating another display example of the twodisplays 376, 378. As an example, it is assumed that the screens 604,606 illustrated in FIG. 8 are displayed on the displays 376, 378. Then,as the posture 26 illustrated in FIG. 11 indicates, it is assumed thatthe manager 20 performs movement of swinging the hand or the arm in thescroll direction. Then, as illustrated in FIG. 12, a screen 610 obtainedby scrolling the screen 606 (see FIG. 8) is displayed on the display378. Note that the screen 604 similar to that of FIG. 8 is displayed onthe display 376.

(Scroll Operation #2)

Further, another method can be adopted to scroll the panoramic imagedata V2 on the display 378. That is, “the manager 20 moves the line ofsight at a predetermined speed in the direction in which the manager 20wishes to scroll”. The line-of-sight detection sensor 400 suppliesline-of-sight direction data GD representing movement of theline-of-sight of the manager 20 to the control unit 310 (see FIG. 4) ofthe information processing device 300. Then, the scroll control unit 314scrolls the panoramic image data V2 in the direction in which the lineof sight has moved on the basis of the line-of-sight direction data GD.As described above, the panoramic image data V2 can be scrolled in anon-contact manner by natural movement of the manager 20.

(Information Transmission to Worker 10)

FIG. 13 is a view illustrating an example of various virtual screens.

The manager 20 can operate the operation unit 350 (see FIG. 4) of theinformation processing device 300 to transmit various types ofinformation to the wearable terminal 100. As a result, for example,virtual screens 1001 to 1003 as illustrated in FIG. 13 are displayed onthe wearable terminal 100. The virtual screen 1001 indicates the causeof the error specified by the manager 20. The virtual screen 1002displays a task specified by the manager 20 and to be executed next bythe worker 10. The virtual screen 1003 shows a map of the destination.

(Resolution Reduction Process)

In FIG. 1, image data V1 and panoramic image data V2 supplied to theinformation processing device 300 via the communication network 600 areusually high-resolution data. However, if a failure occurs in thecommunication network 600 or the like and the communication statedeteriorates, when the high-resolution image data V1 and the panoramicimage data V2 are transferred, the image may be interrupted. Therefore,in the present embodiment, the process of reducing the resolution ofeither the image data V1 or the panoramic image data V2, that is, theprocess of reducing the data rate, is performed.

FIG. 14 is a schematic view illustrating an environment in which aresolution reduction process is performed.

In FIG. 14, when the manager 20 views the large display 378, the rangeof the line of sight is referred to as an “area QA”. When the manager 20views the small-medium display 376, the range of the line of sight isreferred to as an “area QB”. It is assumed that the image data V1 isdisplayed on the display 376, and the panoramic image data V2 isdisplayed on the display 378. The visual image determination unit 318(see FIG. 4) determines which of the areas QA and QB the line-of-sightdirection of the manager 20 belongs to on the basis of the line-of-sightdirection data GD of the line-of-sight detection sensor 400.

FIG. 15 is a flowchart of a resolution reduction process routineexecuted in the control unit 310.

In FIG. 15, if the process proceeds to step S1101, the visual imagedetermination unit 318 (see FIG. 4) acquires the line-of-sight directiondata GD from the line-of-sight detection sensor 400. Next, if theprocess proceeds to step S1102, the visual image determination unit 318determines which of the areas QA and QB the range viewed by the manager20 is. Next, if the process proceeds to step S1103, the visual imagedetermination unit 318 determines whether or not the manager 20 has beengazing at one of the areas QA and QB for a predetermined time (whetheror not the line-of-sight position remains unchanged).

If it is determined to be “No” in step S1103, the process returns tostep S1101, and the above-described operation is repeated. In contrast,if it is determined to be “Yes” in step S1103, the process proceeds tostep S1104, and the visual image determination unit 318 determineswhether the gazed range is the area QA (that is, the panoramic imagedata V2). Here, if it is determined to be “Yes”, the process proceeds tostep S1105. In step S1105, the visual image determination unit 318transmits a signal requesting resolution reduction to the wearableterminal 100.

If the wearable terminal 100 receives this signal, the transmissioncontrol unit 112 (see FIG. 2) of the wearable terminal 100 lowers thedata rate of the image data V1 to reduce the resolution. For example,the original resolution of “4 k/30 fps” is reduced to “Hi-Vision/15fps”. As a result, thereafter, the image data V1 with reduced resolutionis displayed on the small-medium display 376. In contrast, in a casewhere the gazed range is the area QB (that is, the image data V1), it isdetermined to be “No” in step S1104, and the process proceeds to stepS1106.

In step S1106, the visual image determination unit 318 transmits asignal requesting resolution reduction to the surrounding camera 200. Ifthe surrounding camera 200 receives this signal, the transmissioncontrol unit 212 of the surrounding camera 200 lowers the data rate ofthe panoramic image data V2 to reduce the resolution. As a result, thepanoramic image data V2 with reduced resolution is displayed on thelarge display 378 thereafter.

As described above, according to the present embodiment, out of theimage data V1 and the panoramic image data V2, the image being gazed bythe manager 20 is maintained in a high image quality state, and theimage not being gazed by the manager 20 is reduced in image quality. Asa result, the amount of data on the communication network 600 can bereduced. Note that the communication environment is furtherdeteriorated, the transmission control units 112, 212 may stoptransmitting the image data V1 or the panoramic image data V2.

(Focused-on Spot Notification Process #1)

Next, a process in which the worker 10 at the work site W1 is notifiedof a focused-on spot of the manager 20 will be described.

FIG. 16 is a flowchart of a focused-on spot notification routine. InFIG. 16, the processes in steps S1201, S1202, S1203 are similar to thosein steps S1101, S1102, S1103 in FIG. 15. That is, the case where it isdetermined to be “Yes” in step S1203 is a case where the manager 20 hasbeen gazed at one of the areas QA and QB for a predetermined time. If itis determined to be “Yes” in step S1203, the process proceeds to stepS1204, and notifies the wearable terminal 100 of the range that themanager 20 is looking at. Thus, the process of this routine ends.

FIG. 17 is a view illustrating an example of various virtual screens.

If the wearable terminal 100 receives the notification in step S1204described above, the wearable terminal 100 displays, for example,virtual screens 1205, 1206 as illustrated in FIG. 17.

This allows the worker 10 to grasp which of the image of the image dataV1 or the image of the panoramic image data V2 the manager 20 focuseshis or her eyes on. Therefore, the worker 10 is more likely to notice anerror or a situation change.

(Focused-on Notification Process #2)

FIG. 18 is a flowchart of a detailed focused-on notification routine.

This routine allows the worker 10 to grasp the more detailedline-of-sight direction in a case where the manager 20 focuses his orher eyes on the panoramic image data V2. In FIG. 18, if the processproceeds to step S1301, the visual image determination unit 318 (seeFIG. 4) acquires the line-of-sight direction data GD from theline-of-sight detection sensor 400. Next, if the process proceeds tostep S1302, the visual image determination unit 318 determines whetheror not the range viewed by the manager 20 is the area QA. If it isdetermined to be “No”, the process returns to step S1301.

In contrast, if it is determined to be “Yes” in step S1302, the processproceeds to step S1303. Here, the visual image determination unit 318determines whether or not the manager 20 has been gazing at the area QAfor a predetermined time. If it is determined to be “No” here, theprocess returns to step S1301. In contrast, if it is determined to be“Yes”, the process proceeds to step S1304, and the visual imagedetermination unit 318 notifies the surrounding camera 200 of thecoordinate position in the line-of-sight direction. That is, the visualimage determination unit 318 determines which position of the panoramicimage data V2 that is the 360-degrees panoramic image the line-of-sightposition of the manager 20 corresponds to, and notifies the surroundingcamera 200 of the coordinate position. Thus, the process of this routineends.

In contrast, upon receiving the coordinate position described above, thecontrol unit 210 (see FIG. 3) of the surrounding camera 200 controls alaser pointer 222 so as to emit a laser beam to the coordinate position.

FIG. 19 is a schematic view illustrating a focused-on spot notifyingoperation by the laser pointer 222. As illustrated in FIG. 19, the laserpointer 222 emits a laser beam to a focused-on point of the manager 20,so that the worker 10 can easily grasp the focused-on point of themanager 20. As a result, the worker 10 can more easily notice an erroror a change in the situation, and can accurately grasp the part that themanager 20 is gazing at as a work target.

Note that in the above-described process, the focused-on point of themanager 20 is displayed by the laser pointer 222; however, thefocused-on point may be notified in the wearable terminal 100. That is,an image portion that the manager 20 is gazing at on the large display378 may be cut out, the cut-out image portion may be transmitted to thewearable terminal 100, and may be displayed on the display unit 180.

(Thermographic Display Process)

As described above, the environment measurement unit 163 (see FIG. 2) ofthe wearable terminal 100 generates a thermographic image to bereflected in the field of view of the imaging unit 161. It is assumedthat the manager 20 views the image data V1 from the wearable terminal100 on the small-medium display 376 (see FIG. 4). Here, if the manager20 performs a predetermined operation for specifying “thermographicdisplay” on the operation unit 350, the wearable terminal 100 isnotified of the fact via the communication unit 302.

Then, thereafter, the wearable terminal 100 transmits a thermographicimage to the information processing device 300 together with the imagedata V1. When the information processing device 300 receives the imagedata V1 and the thermographic image, the superimposition control unit312 superimposes the image data V1 and the thermographic image andcauses the display 376 to display the image data V1 and thethermographic image.

FIG. 20 is a view illustrating a display example of the display 376 onwhich a thermographic image is superimposed. In the illustrated example,on the display 376, a thermographic image 612 is superimposed anddisplayed in addition to the screen 604 similar to that illustrated inFIG. 12. Note that although the thermographic image 612 is displayed atthe center of the display 376 in the illustrated example, thesuperimposition control unit 312 can freely adjust the display positionof the thermographic image 612 on the basis of a command from themanager 20.

As described above, according to the present embodiment, it is possibleto acquire a thermographic image of the work site W1 by using theenvironment measurement unit 163 of the wearable terminal 100, and notonly the worker 10 but also the manager 20 can visualize a target site.Therefore early detection of a problem is enabled.

Effects of Embodiment

As described above, in a remote work-support system (1) according to thepresent embodiment, a first display device (100) includes a firstdisplay unit (184, 186) that displays information to a first user (10),a first imaging unit (161) that captures an image in front of the firstdisplay device (100) and outputs first image data (V1), and a firstcommunication unit (102) that transmits the first image data (V1) to aninformation processing device (300), a surrounding imaging device (200)includes a second imaging unit (209, 261, 262) that outputs second imagedata (V2) including an imaging range different from an imaging range ofthe first image data (V1), a transmission control unit (201) thatreduces or enhances resolution of the second image data (V2) asnecessary, and a second communication unit (202) that transmits thesecond image data (V2) to the information processing device (300), andthe information processing device (300) includes a second display device(376, 378) that displays the first and second image data (V1, V2), anoperation unit (350) through which data is input, and a thirdcommunication unit (302) that transmits data input by the second user(20) through the operation unit (350) to the first display device (100).

As a result, the first and second users (10, 20) can cooperateappropriately.

In addition, the remote work-support system (1) further includes aline-of-sight detection sensor (400) that detects a line-of-sight of thesecond user (20), and a line-of-sight correspondence control unit (316)that causes the second display device (376, 378) to enlarge and displaya portion corresponding to the line-of-sight in the second image data(V2).

As a result, the second user (20) can enlarge and display a desiredportion by moving his/her line of sight.

Furthermore, the remote work-support system (1) further includes ascroll control unit (314) that scrolls the second image data (V2)displayed on the second display devices (376, 378), in the left-rightdirection or the up-down direction, in a case where the line of sight ofthe second user (20) is in a predetermined state.

Accordingly, the second user (20) can scroll the second image data (V2)by setting the line of sight to a predetermined state.

In addition, the remote work-support system (1) further includes aposture detection unit (500) that detects the posture of the second user(20), and the line-of-sight correspondence control unit (316) causes thesecond display device (376, 378) to enlarge and display a portioncorresponding to the line-of-sight in the second image data (V2) in acase where the posture detection unit (500) detects the predeterminedposture of the second user (20).

Thus, when the second user (20) takes a predetermined posture, theportion corresponding to the line of sight can be enlarged anddisplayed.

Furthermore, the scroll control unit (314) further has a function ofscrolling the second image data (V2) displayed on the second displaydevice (376, 378), in the right-left direction or the up-down direction,in a case where the posture detection unit (500) detects a predeterminedmotion state of the second user (20).

Accordingly, the second user (20) can scroll the second image data (V2)by performing predetermined motion.

Further, the remote work-support system (1) further includes aline-of-sight detection sensor (400) that detects the line of sight ofthe second user (20), a visual image determination unit (318) thatdetermines which of the first and the second image data (V1, V2) thesecond user (20) is viewing on the basis of the line of sight detected,and the transmission control unit (112, 212) that controls the data rateof the first or the second image data (V1, V2) or stops transmission, onthe basis of the determination result of the visual image determinationunit (318).

Thus, for example, in a case where the communication environmentdeteriorates, the data rate of the first or second image data (V1, V2)can be reduced or transmission can be stopped, and the communication canbe continued.

Further, the remote work-support system (1) further includes a screencontrol unit (114) that notifies the first user (10) of thedetermination result of the visual image determination unit (318) viathe first display units (184, 186).

Thereby, the first user (10) can easily grasp the spot on which thesecond user (20) focuses his or her eyes.

Further, the remote work-support system (1) further includes a directiondisplay unit (222) that is mounted on the surrounding imaging device(200) and displays the direction corresponding to the coordinateposition.

Thus, the first user (10) can easily grasp the spot on which the seconduser (20) focuses his or her eyes from displayed content on thedirection display unit (222).

<Modification>

The present invention is not limited to the embodiment described above,and various modifications are possible. The above-described embodimentis exemplarily illustrated for easy understanding of the presentinvention, and is not necessarily limited to those having all theconfigurations described above. Further, another configuration may beadded to the configuration of the above-described embodiment, and someof the configurations may be replaced with another configuration.Further, the control lines and information lines illustrated in thedrawings indicate those considered necessary for the description, and donot necessarily indicate all the control lines and information linesnecessary for a product. In fact, it can be considered that almost allcomponents are interconnected. Possible modifications to the aboveembodiment are, for example, as follows.

(1) In the above embodiment, an example in which the distancemeasurement sensor 500 is applied as a specific example of the “posturedetection unit” has been described. However, as long as a device candetect the posture or movement of the manager 20, the device can beapplied instead of the distance measurement sensor 500. For example, amotion capture system that captures a moving image of the manager 20 anddetects the posture of the manager 20 can be applied. Further, a sensorthat detects the bending angle of the joint of each part may be attachedto the manager 20, and the posture and the movement of the manager 20may be detected by the sensor.

(2) Since the hardware of the information processing device 300 in theabove embodiment can be realized by a general computer, the flowchartsillustrated in FIGS. 15, 16, and 18, other programs for executing theabove-described various processes, and the like may be stored in astorage medium or distributed via a transmission path.

(3) The processes illustrated in FIGS. 15, 16, and 18 and otherprocesses described above have been described as software processesusing a program in the above-described embodiment. However, theprocesses may be replaced by hardware processes using an applicationspecific integrated circuit (ASIC), an IC for a specific application, ora field programmable gate array (FPGA).

What is claimed is:
 1. A remote work-support system comprising: a firstdisplay device to be worn on a first user working at a work site; asurrounding imaging device disposed on the work site; and an informationprocessing device provided at a predetermined spot, configured tocommunicable with the first display device and the surrounding imagingdevice, and operated by a second user, the first display deviceincluding a first display unit that displays information to the firstuser, a first imaging unit that captures an image in front of the firstdisplay device and outputs first image data, and a first communicationunit that transmits the first image data to the information processingdevice, the surrounding imaging device including a second imaging unitthat outputs second image data including an imaging range different froman imaging range of the first image data, and a second communicationunit that transmits the second image data to the information processingdevice, and the information processing device including a second displaydevice that displays the first image data and the second image data, anoperation unit through which data is input, and a third communicationunit that transmits data input by the second user through the operationunit to the first display device.
 2. The remote work-support systemaccording to claim 1 further comprising: a line-of-sight detectionsensor that detects a line-of-sight of the second user; and aline-of-sight correspondence control unit that causes the second displaydevice to enlarge and display a portion corresponding to theline-of-sight in the second image data.
 3. The remote work-supportsystem according to claim 2, further comprising a scroll control unitthat scrolls the second image data displayed on the second displaydevice in a right-left direction or an up-down direction, in a casewhere the line of sight of the second user is in a predetermined state.4. The remote work-support system according to claim 2 furthercomprising: a posture detection unit that detects a posture of thesecond user, wherein the line-of-sight correspondence control unitcauses the second display device to enlarge and display the portioncorresponding to the line-of-sight in the second image data in a casewhere the posture detection unit detects a predetermined posture of thesecond user.
 5. The remote work-support system according to claim 4further comprising a scroll control unit that scrolls the second imagedata displayed on the second display device in a right-left direction oran up-down direction, in a case where the posture detection unit detectsa predetermined motion state of the second user.
 6. The remotework-support system according to claim 1 further comprising: aline-of-sight detection sensor that detects a line of sight of thesecond user; a visual image determination unit that determines which ofthe first image data and the second image data the second user isviewing on a basis of the line of sight detected; and a transmissioncontrol unit that controls a data rate of the first image data or thesecond image data or stops transmission, on the basis of a determinationresult of the visual image determination unit.
 7. The remotework-support system according to claim 1 further comprising: aline-of-sight detection sensor that detects a line of sight of thesecond user; a visual image determination unit that determines which ofthe first image data and the second image data the second user isviewing on a basis of the line of sight detected; and a screen controlunit that notifies the first user of a determination result of thevisual image determination unit via the first display unit.
 8. Theremote work-support system according to claim 1 further comprising: aline-of-sight detection sensor that detects a line of sight of thesecond user; a visual image determination unit that determines which ofthe first image data and the second image data the second user isviewing on a basis of the line of sight detected, and detects acoordinate position viewed in a case where the second user views thesecond image data; and a direction display unit that is mounted on thesurrounding imaging device and displays a direction corresponding to thecoordinate position.